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Abstract 

Team-Based Learning (TBL) is a collaborative teaching method in which students utilize course content to solve 
challenging problems. A modified version of TBL is used at the University of Louisville School of Medicine. 
Students complete questions on the Individual Readiness Assurance Test (iRAT) then gather in pre-assigned groups 
to retake the quiz, given time to utilize their learning resources and discuss each of the questions (Team Readiness 
Assurance Test-tRAT). Following this discussion, students take an Individual Summative Assessment Test (iSAT) 
with new questions at a similar cognitive level and content focus. While educational gains of TBL have been shown, 
student evaluations negatively assessed the teaching method with complaints regarding question difficulty and stress 
levels. Thus, during implementation of TBL in the School of Dentistry, three main changes were made: (1) The 
contribution of TBL to the overall grade was reduced (2) TBL questions were cognitively aligned with unit exam 
questions, and (3) Scratch-off, lottery response cards were used to create a fun, game-like environment. This revised 
TBL format, compared to the original format, resulted in similar student performance during iRAT and tRAT 
sessions. However, the revised, low-stress format had significantly higher scores on the iSAT (n=l 19-161, p <.05). 
Furthermore, students participating in the revised TBL format reported higher effectiveness of the learning format, 
higher levels of perceived fairness, and lower stress levels. These results suggest that the qualitative experience of 
students may be an important consideration that should be carefully evaluated during implementation of a new 
teaching technique. 
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1. Introduction 

Team-Based Learning (TBL) was first developed by Dr. Larry Michaelsen in the 1980’s for use in business classes 
(Michaelsen, 1983). Since that time, TBL has been implemented in medical, dental, and other professional schools 
across the nation (Parmelee, 2010). TBL consists of three basic components: (1) preparation for sessions through 
readings or other assignments (2) assessment of student preparation through an Individual Readiness Assurance Test 
(iRAT) and Team Readiness Assurance Test (tRAT) and (3) application of course concepts through activities 
(Parmelee, Michaelsen, Cook, & Hudes, 2012). The goal of Team-Based Learning is to allow students to become 
active participants in their own education by applying their knowledge to solve questions. As opposed to the 
traditional didactic lecture, in which students are merely exposed to course content, TBL allows students to become 
accountable for their work, receive timely feedback on their performance, and develop the critical thinking skills 
necessary to apply their content knowledge (Michaelsen, Knight, & Fink, 2002). 

Team-based learning has been shown to improve professional student performance on examinations, particularly for 
at-risk students in the bottom quartile of the course (Koles, Stolfi, Borges, Neson, & Parmelee, 2010). In medical 
schools, research suggests that TBL improves communication skills and National Board of Medical Examiners shelf 
examination scores (Hunt, Haidet, Coverdale, & Richards, 2003; Levine et al., 2004). Furthermore, medical students 
have been found to have favorable perceptions of the TBL strategy and their interactions with teammates (Vasan, 
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DeFouw, & Compton, 2009). However, while the original format of TBL has been shown to have a positive impact 
on student performance, this method has often been revised to accommodate differing needs in class sizes, time 
allocation, curricula, administration, etc. As the method became more popular over the past 30 years, many 
institutions diverged from the standard TBL methodology (Parmelee, 2010). 

At the University Louisville School of Medicine, a revised TBL method has been employed since 2006. In this 
strategy, the third component of the traditional TBL, during which students typically apply the course concepts 
through activities, has been replaced with a third assessment. This Individual Summative Assessment Test (iSAT) 
requires students to utilize the knowledge gained during the team session on new questions at a similar cognitive 
level. This alteration was primarily made due to the time restrictions imposed by a busy didactic schedule and large 
class sizes. While positive educational gains of this revised TBL have been documented, and will be presented in the 
current manuscript, student evaluations often negatively assessed the teaching method with complaints regarding 
question difficulty and stress levels. This feedback posed a significant concern for faculty interested in extending the 
teaching method to the School of Dentistry. 

It has been reported that dental students experience higher levels of stress than medical students, which can 
negatively impact academic performance (Bilks, McKendree, & Watt, 2009). Furthermore, high levels of stress 
among dental students have been associated with mental and physical illness, burnout, and social isolation 
(Silverstein & Kritz-Silverstein, 2010; Dahan & Bedos, 2010). Surprisingly, few studies since the 1980’s have 
examined methods by which to reduce dental student stress (Elani et al., 2014). It is quite clear that the landscape of 
dental education has changed significantly during that time, with the addition of not only new content areas but also 
the implementation of new teaching techniques such as active, problem-based, and team-based learning (Par & 
Howell, 2015; Bassir, Sadr-Eshkevari, Amirikhorheh, & Karimbux, 2013; Takeuchi et al., 2015). While the effects 
of these teaching methods on academic success have been thoroughly evaluated, educators often neglect to assess the 
impact of the techniques on student stress levels. This is particularly important given the extremely busy didactic and 
clinical schedules imposed on dental students. Studies suggest that academic workload, study pressures, 
examinations, and changes in curriculum design can all contribute to dental student stress (Alzahem, van der Molen, 
Alaujan, Schmidt, & Zamakhshary, 2011). 

Thus, when implementing TBL into the School of Dentistry, it was necessary to make some alterations to the 
existing model from the School of Medicine, and to thoroughly assess and compare the effectiveness of the two 
strategies. In order to reduce the stress and frustration levels of students when implementing TBLs in the School of 
Dentistry, three primary changes were made. First, the contribution of TBL to the overall grade was reduced from 29% 
to 2% to transform the activities from high-stakes to low-stakes. Second, TBL questions were cognitively aligned 
with unit exam questions. Historically, the medical school TBL questions were developed at an extremely high 
cognitive level, pushing students to assess their highest level of comprehension. This reflects the overall goal of the 
Medical Physiology course to prepare students for intricate cases involving human pathologies. On the other hand, 
the Dental Physiology course focuses on more integrative physiological concepts that are applicable to the practice 
of dentistry. Thus, it was more appropriate to align the TBL questions in Dental Physiology with the summative unit 
exams. Lastly, scratch-off, lottery response cards were used to create a fun, game-like environment, as opposed to 
the written feedback given by faculty proctors in the medical school. This allowed for instantaneous and less 
stressful feedback in the new dental TBL. It was hypothesized that the revised, low-stress TBL format would result 
in similar educational gains but an improvement in the qualitative experience of students. 

2. Methods 

2.1 Participants and Course Design 

This study was completed at the University of Louisville Schools of Medicine and Dentistry in Louisville, Kentucky, 
United States. Medical Physiology is a general science course for 1 st year M.D. students with an enrollment of 160 
students, while Dental Physiology is a general science course for 1 st year D.M.D. students, with an enrollment of 120 
students. The courses are team-taught by faculty members in the Department of Physiology & Biophysics and follow 
a systems-based approach. Medical Physiology consists of approximately 10 hours of lecture per week, with 
additional sessions comprised of Problem-Based Learning (PBL sessions), Patient Simulations with medical 
mannequins, and Team-Based Learning. Dental Physiology consists of 6 face-to-face contact hours per week, with 
the majority of the class sessions consisting of engaging lectures as previously described (Miller, McNear, & Metz, 
2013). In engaging lectures, also referred to as broken or interactive lectures, students are given short periods of 
lecture, followed by “breaks” that can consist of minute papers, problem sets, brainstorming sessions, or open 
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discussion. Outside of class, D.M.D students also utilize online learning, comprised of a number of Camtasia videos 
(http://www.techsmith.com/camtasia.html) and Softchalk exercises (https://www.softchalkcloud.com) 
custom-designed by the P.I of this study. Dr. Cynthia J. Miller (Miller, Aiken, & Metz, 2015). 

2.2 General Design ofTBL Sessions 

Figure 1 illustrates the general setup of the Team-Based Learning sessions for both Medical and Dental Physiology 
courses. This method is a modification of the traditional TBL format developed by Michaelsen and Sweet (2008). All 
students were asked to prepare for the TBL using posted study guides, practice problem sets, professor-designed 
class notes, and online recordings of the previous class lectures. For part one, the Individual Readiness Assurance 
Test (iRAT), students report to assigned seating locations and complete ten multiple-choice questions on scantron 1 ' 
response forms. Following this session the response sheets are collected by faculty proctors, but the students retain 
the questions along with any written notations they have made. For part two, the Team Readiness Assurance Test 
(tRAT), the students discuss these same questions with their assigned team members. Additionally, students are 
allowed to consult their notes or textbooks for further guidance on the content. Teams are encouraged during the 45 
minute tRAT session to discuss alternative methods in which the content could be assessed, thus brainstorming 
potential questions for part three. During the final Individual Summative Assessment Test (iSAT), students are asked 
to complete ten new multiple-choice questions that re-evaluate the same content areas. These questions are 
peer-reviewed by faculty to ensure that Part one and three questions are at a similar cognitive level. Students have 30 
minutes to complete the iSAT questions on scantronresponse forms. At the conclusion of the session, students 
retain the questions and are given the opportunity to view the correct answers and discuss remaining areas of 
confusion with the professors. 


Team-Based Learning (TBL) Format 



Individual Readiness 
Assurance Test 


• Students report to 
assigned locations 

• 10 multiple-choice 
questions 

• Duration: 30 minutes 

• From memory 

• By scantron 



Team Readiness 
Assurance Test 


• Same questions as 
Part 1 

• 10 multiple-choice 
questions 

• Duration:45 minutes 

• Utilize knowledge of 
classmates, notes, 
textbooks 



Individual Summative 
Assessment Test 


• New questions on 
same content areas 

• 10 multiple-choice 
questions 

• Duration:30 minutes 

• From memory 

• By scantron 


Figure 1. General Schematic for Team-Based Learning 


2.3 Comparison ofTBL Design for Medical and Dental Courses 

While the same general setup was used for both Medical and Dental Physiology TBL sessions, there were significant 
differences in the design shown in Table 1. The first three rows indicate differences between the two groups that 
were largely outside of the control of this study, while the last three rows indicate changes purposefully made by the 
investigators. The design of the School of Medicine facility for TBL consisted of six unit labs with capacity for 
approximately 30 students for the iRAT and iSAT components. Attached to each of the unit labs were three 
conference rooms that allowed between eight-nine students to discuss the tRAT questions privately. This setup 
required three faculty proctors, with each proctor being responsible for two unit labs and the six attached conference 
rooms. The class size during the current study was 161 students, with one student repeating the course following 
unsuccessful completion during the previous year. 

The School of Dentistry lacks the unit labs present in the School of Medicine facilities, so the TBL sessions were 
held in a large auditorium with capacity for 435 occupants. Each team was comprised of four students, and teams 
were assigned seat locations in the large room that prohibited communication between different groups. For this 
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study, 119 students were enrolled in the course, with one student withdrawing from the program prior to completion 
of the study. 

Table 1. Comparison of TBL formats for Medical and Dental Physiology 


Medical Physiology 

Dental Physiology 

History 

TBL units first implemented in 2006, 
6TBLs/course 

Pilot TBL units implemented in 
2013, 2 TBLs/course 

Environment 

Students distributed into 6 unit labs 
for parts 1 and 3, 18 adjacent 
conference rooms for part 2 

All parts completed in large 
auditorium (capacity of 435) 

Group Size 

Class size of 161 with 9 students per 
group 

Class size of 119 with 4 students per 
group 

Overall % of grade 

Each part weighted eaually, 29% of 
overall grade 

Each part weighted eaually, 2% of 
overall grade 

Difficulty level of questions 

Higher cognitive lever than exams 

Alighted with exams 

Format ofpart2(tRAT) 

Hand graded by 3 faculty proctors 

IF-AT forms with w proctors 
available 


During implementation of TBL in the School of Dentistry, three main changes were planned, as indicated in the last 
three rows of Table 1. First, the contribution of the TBL to the overall grade in the course was reduced. In Medical 
Physiology, six TBLs were administered during the course that comprised 29% of the overall grade. To pilot the 
current study, two TBLs were implemented into the Dental Physiology course that comprised 2% of the students’ 
grades. Each portion of the TBL (iRAT, tRAT, and iSAT) was weighted equally. 

While the questions on the dental TBL assessments were still at high levels on Bloom’s Taxonomy, they were 
developed to be aligned with the cognitive level of unit exams in the course. Conversely, the medical school TBL 
questions are at a higher cognitive level than the unit exams in the course. For example: 

Sample TBL question from Medical Physiology: 

Which of the following is FALSE related to proximal tubular function? 

A. If GFR is 120 ml/min, urine flow rate is 1 ml/min, and plasma X is 2 mg/ml and urine X is 60 mg/ml; then net 
reabsorption is filtered amount minus excreted amount for substance X. 

B. Sodium reabsorption by the proximal tubule is not Tm limited, it is instead limited by the paracellular sodium 
concentration gradient that will be developed at some time along the length of the proximal tubule. 

C. *If GFR is 120 ml/min, urine flow rate is 1 ml/min, and plasma X is 2 mg/ml and urine X is 60 mg/ml; then net 
reabsorption ofX is 60 mg/min. 

D. Increasing GFR by increasing glomerular capillary pressure will be matched by increased tubular 
reabsorption because of increased PCOP in the peritubular capillary circulation. 

E. A reduced Tm for glucose one day after abdominal surgery very likely indicates a decrease in the number of 
nephrons being perfused within one or both kidneys. 

* denotes correct answer 

Sample TBL question from Dental Physiology: 

Which of the following would result in the lowest concentration of sodium in the urine? 

A. High ADH, high Aldosterone, high ANP 

B. High ADH, low Aldosterone, high ANP 

C. Low ADH, low Aldosterone, high ANP 

D. *Low ADH, high Aldosterone, low ANP 

E. Low ADH, low Aldosterone, low ANP 
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* denotes correct answer 

The third and final, planned change in the two TBL formats was the proctor format for Part 2: the tRAT. In Medical 
Physiology, teams answered all ten questions on the tRAT, and then submitted their handwritten answers to a faculty 
proctor for grading. Any incorrect answers were circled in red ink, and the students returned to their groups to submit 
subsequent responses as necessary. In the pilot TBL sessions in the Dental School, Immediate Feedback Assessment 
Technique (IF-AT) forms were utilized (Epstein Educational Enterprises, Cincinatti, OH). These scratch-off, 
lottery-style cards enable teams to receive immediate feedback on the submitted responses. For each question, the 
correct response (A-E) is indicated by a star beneath an easily removed silver material. If the scratched-off response 
does not contain this star, it indicates that an incorrect answer was chosen and teams must try again to solve the 
question. Several different versions of the cards can be ordered, with each version containing a different 
pre-determined key. Faculty members must scramble their response items to match the pre-determined key. The code 
for the keys is shown on a perforated strip at the bottom of the card for easy removal prior to student distribution. 
This method requires minimal intervention of faculty members during the tRAT session, thus reducing the need for 
multiple faculty proctors. 

2.4 Assessments 

All of the questions were peer-reviewed by faculty in the Department of Physiology & Biophysics to determine 
appropriate content level and verify that each question had one best answer from the five responses (A-E). iRAT and 
iSAT scantron !< response forms were read, and each question comprised 10% of the total grade for that assessment. 
On the tRAT, points were deducted for each incorrect “guess” submitted by teams with reductions in percentage 
from 10% (correct on first attempt), 5% (correct on second attempt), 2% (correct on third attempt), 1% (correct on 
fourth attempt), and 0% (correct on fifth attempt). 

2.5 Formation of Teams 

Teams for the tRAT portion of the TBL were designed by the course directors of the medical and dental classes to 
contain students with a range of academic performance levels. Custom excel files were developed that matched one 
top-performing student (based on their current average in the course), one lower-performing student, and two 
mid-level-performing students. The mean team averages in the course were within 5% from one another. The classes 
are comprised of approximately 50% of each gender, so no attempts were made to assign teams based on sex or other 
characteristics. New TBL teams were assigned for each session, in order to enable students to work with a variety of 
new classmates throughout the semester. 

2.6 Survey Tool 

Following completion of the final TBL session and the corresponding summative unit exams, students were 
administered a survey containing 13 Likert-scale questions and two open-response questions. These consisted of both 
positive and negative stems that were developed by the investigators of the study. The goal of the survey was to 
determine any differences in student perceptions of the TBL effectiveness, team communication, question difficulty 
level, and stress level. Multiple questions were developed to assess each of these four themes, and were mixed within 
the survey instrument. Students were given the opportunity to complete a hard-copy of the survey following the final 
TBL in the course. The response rate for medical students was 96% (154/161) and dental students was 89% 
(106/119). For the Likert Scale: l=Strongly Disagree, 2=Disagree, 3=Neither Agree nor Disagree, 4=Agree, 
5=Strongly Agree. For the open-response questions, students were asked to respond to two prompts: 1. What are the 
main strengths of the TBL? 2. What changes would help the TBLs achieve the learning objectives of the course? 
Open-responses were analyzed using a grounded theory approach to determine themes. 

2 .7 Data Analysis and IRB Approval 

Statistical analyses were performed using Origin software version 8.1 (OriginLab, Northampton, MA), as shown in 
the figure legends, with statistical significance defined as p < .05. This study was determined to be IRB exempt by 
the University of Louisville (Tracking #: 13.0267, 6/26/2013). 

3. Results 

3.1 TBL Performance Results 

Student averages from each of the TBL sections are shown in Figure 2. The data from medical students, shown on 
the left, is comprised of averages from 6 TBLs, while the dental school data on the right consists of student averages 
from the 2 pilot TBL sessions. All pairwise comparisons were performed using one-way analysis of variance and the 
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Tukey post-hoc test. The revised dental TBL format, compared to the original medical format, resulted in similar 
student performance during iRAT and tRAT sessions. However, the revised, low-stress format had significantly 
higher scores on the iSAT (n=l 19-161, p <.05). 


too 

80 

Score 60 
(%) 

40 

20 

0 

iRAT tRAT iSAT iRAT tRAT iSAT 

Medical Dental 

Figure 2. Comparison of TBL Performance for Medical and Dental Students 

For medical data: n=6 TBLs, 161 students, 966 individual scores; For dental data: n=2 TBLs, 119 students, 238 
individual scores. Data presented as means ± SD, * p<.05. One-way ANOVA and Tukey post-hoc test. 

3.2 Survey Results 

In order to compare student perceptions of the two TBL formats, Likert-scale surveys were administered. Figure 3 
compares the student perceptions of the overall effectiveness of the teaching method. Dental students indicated more 
positive perceptions of the impact of TBL on their understanding of class content, exam performance, and benefits in 
learning (n=106-154, Mann-Whitney U test for non-parametric, ordinal data). 

Overall Perceived Effectiveness of TBLs 




It was also necessary to determine if the revised TBL strategy had an effect on group dynamics during the session. 
As shown in Figure 4, there were no significant differences between the two groups when asked to evaluate the 
communication of the team, personal contribution to the team, or peer-assistance during the session. All responses 


Published by Sciedu Press 


6 


ISSN 1925-0746 E-ISSN1925-0754 




http://wje.sciedupress.com 


World Journal of Education 


Vol. 5, No. 4; 2015 


positively evaluated the effectiveness of team interactions with mean scores ranging from 3.95-4.24 on the 5-point 
Likert scale. 


Effectiveness of Team Interactions 


Statement 4A: 

My team communicated effectively 
during the TBLs 

Statement 4B: 

My peers helped me to learn the 
physiological concepts during the 
TBLs 


Statement 4C: 

I contributed to my peers' 
understanding of the physiological 
concepts during the TBL 



■ Medical Students 
□ Dental Students 


Strongly 

Disagree 


Disagree 


Strongly 

Agree 


Figure 4. Likert-scale Survey Data on Student Perceptions of Team Effectiveness 
n=106-154, data presented as means ± SD, * p<.05, Mann Whitney U test used for non-parametric, ordinal data 


A major concern with the pre-established medical school TBL format was the student perception of fairness and 
question difficulty level. Indeed, Figure 5 indicates that the medical students involved in the higher-stress TBL 
format, when compared to the dental students, reported that the TBL questions were more difficult than exam 
questions, the questions were less fair, and that their scores on the TBL did not as accurately reflect their 
understanding of the material. Furthermore, the differences between the medical and dental students were 
statistically significant, with mean responses differing by 0.72, 1.27, and 1.08 points respectively on a 5-point Likert 
scale (*p<.00001). The perceived lack of fairness may also impact student stress levels, as displayed in Figure 6. 
Dental students perceived the revised TBL method to be less stressful and less frustrating than their medical school 
counterparts. 


Perception of Question Difficulty Level 
and Fairness 


Statement 5A: 

I felt that the TBL questions were 
more difficult than the exam 
questions 


Statement 5B: 

I felt that the TBL questions were 
fair 


Statement 5C: 

I felt that my scores on the TBLs 
reflected my understanding of the 
material 

12 3 4 




■ Medical Students 
□ Dental Students 

— 1 * 


* 


5 


Strongly Disagree Neutral Agree Strongly 
Disagree Agree 


Figure 5. Likert-scale Survey Data on Student Perceptions of Question Difficulty Level and Fairness 
n=106-154, data presented as means ± SD, * p<.00001, Mann Whitney U test used for non-parametric, ordinal data 
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Student Stress Levels 


■ Medical Students 
□ Dental Students 


Statement 6B: 

I found the TBLs to be frustrating 


1 2 3 4 5 

Strongly Disagree Neutral Agree Strongly 

Disagree Agree 

Figure 6. Likert-scale Survey Data on Student Perceptions of Their Stress Levels 
n=106-154, data presented as means ± SD, * p<.00001, Mann Whitney U test used for non-parametric, ordinal data 



Statement 6A: 

I found the TBLs to be stressful 


On the open-response questions, the following three strengths of TBL were emphasized by both medical and dental 
students: 

• Learning from classmates and peer interactions (66 medical students, 32 dental students) 

• Time management and a reduction in procrastination (59 medical students, 17 dental students) 

• Preparation for exams (42 medical students, 77 dental students) 

Additionally, many dental students (33) reflected on the ability of TBL to improve their understanding of the content 
by identifying areas of strength and weakness. A dental student commented, “ The TBL benefits everyone. It benefits 
those that understand the material well, because they will teach it more and therefore understand the material better. 
To the people who are struggling with the material, they will get different points of view teaching it to them as a 
team." 

When asked what changes would help to achieve the learning objectives of the course, the medical students largely 
reported a reduction in question difficulty, or an increase in the clarity of questions (38). As one medical student 
wrote, “We don’t go through TBL style questions in class, so they are significantly more difficult than the material 
presented in class. They seem to be designed to trip you up and confuse you rather than to clarify and re-teach the 
course material. It seems as if the professors enjoy making excessively difficult questions, then refuse to help 
understand the concept under the guise of “student learning. ” They are paid to teach us when we are confused. I 
learn very’ little from eight other equally confused students." 

The dental students participating in the revised TBL format primarily suggested that more TBL sessions be 
incorporated into the course, or that more questions be included on each TBL (29). 

3.3 Instructor Observations from the Dental Physiology’ Course Director 

There was significant faculty apprehension regarding the implementation of TBL in the School of Dentistry, due to 
previous interactions with medical students. Through informal conversations with medical students, there were many 
complaints that the faculty were “trying to trick them” with the TBL questions. Some students did, however, 
recognize the educational benefit of the process despite their frustration levels. Both medical and dental students 
have extremely busy and often stressful schedules, and there was concern that implementation of the new teaching 
technique with dental students would only compound these issues. 

When introducing TBL to the dental students, students were encouraged to use their team-members’ knowledge to 
help grow in their own comprehension of the material. During the very first iRAT session, a number of students did 
appear to be stressed, but this seemed to disappear during the tRAT session as students began to work together. 
Particularly, once they began scratching items off of the IF-AT forms, simultaneous exclamations of joy or 
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(good-natured) groans could be heard echoing throughout the large room. The students were without a doubt having 
fun during the process, and I personally enjoyed eavesdropping on some extremely enriching conversations. The 
overwhelming response of the students was that they wanted a TBL session prior to each of the four unit exams in 
the course. Time-allowing, this will be implemented into next year’s course, along with a longer (50 question) 
session to review for the final exam. 

4. Discussion 

Team-Based Learning has been used in the University of Louisville School of Medicine since 2006 and has shown 
positive educational effects on student performance. However, the students often expressed negative reviews of the 
TBL process. The literature suggests that other institutions may experience similar difficulties in implementation, but 
that student attitudes toward TBL may improve with time and refinement of the teaching technique (Davidson, 2011). 
A study conducted at Baylor College of Medicine and the University of Texas, Houston College of Medicine 
reported that while TBL resulted in similar educational results relative to traditional didactic lectures, the medical 
residents more favorably perceived the lectures (Haidet, Morgan, O’Mallery, Moran, & Richards, 2004). 
Interestingly, their study also utilized a revised TBL strategy from the original format. 

Michaelsen and Richards acknowledged that it may be difficult to extend the traditional TBL format into health 
sciences education, and these alterations may diminish the effectiveness of the teaching strategy (2005). The 
integration of multiple courses in professional curricula, high number of lecturers, and attendance issues were all 
cited as potential areas of difficulty. It has been argued that the classic TBL format is well-tested and that divergence 
from this method will negatively impact student learning (Parmelee, 2010). In the original concept of TBL, 
Michaelsen proposed that active learning sessions follow the iRAT and tRAT portions. However due to large class 
sizes and time constraints, the School of Medicine at UofL replaced the active learning component with summative 
iSAT questions. Thus, to best compare the effectiveness of the Dental Physiology pilot TBL sessions, it was 
necessary to follow this established model at the institution. 

One major difference between the two TBL formats compared in the present study was the cognitive level of the 
exam questions. The original, medical school TBL format had questions at a much higher cognitive level than exam 
questions. In the revised, low-stress dental TBL, students were asked to answer questions at a cognitive level aligned 
with the unit exams. On surveys, the students confirmed their perceptions of this change, with medical students 
reporting that the TBL questions were more difficult than exam questions, the questions were less fair, and that their 
scores on the TBL did not as accurately reflect their understanding of the material. Another major change was that 
the contribution of the TBL sessions to the overall grade was reduced from 28% to 2%, in an attempt to reduce 
student stress levels during the formative TBL assessments. High-stakes assessments have been found to lower the 
motivation to learn, and to emphasize attainment of scores rather than mastery of course concepts (Harlen & Crick, 
2003). Research suggests that for formative assessments to be most successful, they must be administered under 
situations that are as stress-free and low-stakes as possible (Rolfe & McPherson, 1995). 

Another stress reduction strategy was the employment of a lottery-style, scratch-off cards during the team portion of 
the TBL. It has been argued that professional education has been extremely resistant to games and other innovative 
educational techniques, but that these strategies are beneficial in improving student comprehension, interest in the 
material, and interaction with classmates (Handfield-Jones & Nasmith, 1993). The goal of the scratch-off cards was 
to allow students instantaneous feedback on their group performance, while also reducing stress during the TBL 
session due to the fun atmosphere. Use of the IF-AT forms has been found to decrease student misconceptions of the 
material, while also improving long-term retention of the content relative to traditional testing techniques (Epstein et 
al„ 2002). 

Surprisingly, despite these changes to the TBL design, there were no significant differences in iRAT and tRAT 
scores between the medical and dental students. This may attest to the different focuses and expectations of the 
programs. The medical school curriculum strives to push students to a very high comprehension of physiology, in 
order for students to fully comprehend all pathologies and treatments of the human body. Conversely, the dental 
school curriculum is designed to emphasize long-term mastery of more basic physiological processes that relate to 
dentistry. Thus, due to the very nature and expectations of the courses, students may be rising to similar levels of 
achievement on TBL questions, despite differences in the cognitive level. 

In both TBL formats, there was a statistically significant improvement in tRAT and iSAT scores relative to the 
preceding iRAT scores. The improvement in tRAT scores would be expected, since partial credit is given for 
incorrect answers and the students are also working in teams. It is intuitive that team performance and assimilation of 
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knowledge would surpass that of the individual. Indeed, previous research has shown that collaborative examinations 
improve student scores on physiology exams, particularly for at-risk students with poor individual performance 
levels (Giuliodori, Lujan, & DiCarlo, 2008). It was shown that students were more likely to change their responses to 
correct answers in a group setting, and that long-term retention of the information was improved following 
collaborative examinations (Cortwright, Collins, Rodenbaugh, DiCarlo, 2003; Giuliodori, Lujan, & DiCarlo, 2009). 
Furthermore, the “open-book” design of the tRAT session would be predicted to raise performance levels (Agarwal, 
Karpicke, Kang, Roediger, & McDermott, 2008). Thus, the inherent design of the tRAT session would be expected 
to cause a significant increase from the iRAT. 

The dental students participating in the low-stress TBL format showed significantly higher performance levels than 
medical students on the final iSAT section (5.2% increase). This could indicate that the lower cognitive level of the 
questions allowed the dental students to better master the concepts in the discussion time provided. This was 
supported by the fact that a large number of dental students reflected on the ability of TBL to improve their 
understanding of the content by identifying areas of strength and weakness. Conversely, the lower stress level during 
dental TBL may have positively impacted the students’ ability to gain knowledge during the session. As one medical 
student participating in the high-stress TBL commented, “ People get too stressed and frustrated about the right 
answer when tied to a grade and it reduces the ability to think clearly and learn the underlying concepts 

Stress may be an inherent component of any professional program, as students are pushed to their mental, physical, 
and educational limits. Thus, it was of paramount importance that the new TBL sessions did not increase the stress 
imposed on dental students. Indeed, dental students participating in the revised TBL format reported lower levels of 
stress and frustration, when compared to the medical students. Previous studies by our group indicated that dental 
students were often overwhelmed by their responsibilities in and out of the classroom (Miller, McNear, & Metz, 
2013). In fact, one study showed that dental students were more likely than medical students to experience 
psychological stress, with 20.4% of the dental students exhibiting pathological results compared to 5.5% of medical 
students (Prinz, Hertrich, Hirschfelder, & De Zwaan, 2012). While some established professors may envision that 
students must “pay their dues” by suffering through professional programs, research has shown that stress negatively 
impacts memory retrieval (Kuhlmann, Piel, & Wolf, 2005). Furthermore, the continual presence of stress may 
contribute to a reduction in empathy that occurs as students’ progress through their educational careers (Neumann et 
al., 2011). 

Lack of empathy may inhibit health care providers from interacting proficiently with both patients and fellow 
clinicians. Team dynamics are difficult to establish, and it has been shown that students have poor perceptions of 
group work in educational settings (Troth, Jordan, & Lawrence, 2012). One of the main components of the TBL 
format designed by Michaelsen was the development of consistent groups that unified as the course proceeds (2008). 
In the current study, however, new assigned groups were formed for each of the study sessions. 

As previously described by our group, the remaining face-to-face class time in Dental Physiology employs engaging 
lectures (Miller, McNear, & Metz, 2013). In this teaching method, students are given short periods of lecture, 
following by “breaks” in which they work with classmates to complete activities such as completing one-minute 
papers, hypothesizing patient outcomes, classifying components, etc. The collaborative nature of these activities 
creates strongly-unified, but self-selected groups in the classroom. Further data collected demonstrated that at-risk 
students may poorly select partners for these classroom activities, which may lead to not only deficiencies in 
knowledge, but also ultimate failure of the course (Miller & Metz, 2014). Thus, during the pilot TBL sessions, it was 
desired to create new group assignments each time, in order to allow students to interact with additional classmates 
and build an increased support network in the class. However, it has been suggested that newly formed teams may 
experience interactions that cause high anxiety and uncertainty (Sweet & Michaelson, 2007). Thus, it is widely 
recommended that student teams be consistent for all TBL sessions in a course (Michaelsen, 2008). Despite the new 
teams assigned for each TBL in the current study, students subjectively reported high levels of team effectiveness on 
the surveys. There were no significant differences between the perceived team effectiveness of the two formats, 
despite large differences in group sizes (four students vs. nine students) and classroom environment for the team 
sessions. Thus, alteration of the classic method of TBL group formation may be beneficial in some cases, depending 
on the other alternative teaching strategies being employed. 

One large confounding variable that could affect the current study is that two different populations of health sciences 
students were compared. Both medical and dental students are admitted through a rigorous admissions process, and 
have extremely high entrance exam scores and GPA. In 2013, the year in which the current study was completed, the 
entering medical school class had a cumulative undergraduate GPA of 3.64, science GPA of 3.56, and biological 
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science MCAT score of 10.05 (University of Louisville School of Medicine, 2015). The entering dental school class 
had a cumulative undergraduate GPA of 3.51, science GPA of 3.39, and biology DAT score of 19 (University of 
Louisville School of Dentistry, 2015). Thus, the two groups involved in the study appeared to have similar academic 
backgrounds. However, some studies have shown that while students entering into professions in the health sciences 
may have similar academic success, there may be different reasons that motivate students to choose their respective 
fields. For example, one such study found that medical students are motivated to enter their field due to career 
opportunities, an interest in science, and a desire to work with people, while students were motivated to choose 
dentistry in response to more personal factors such as working hours, independence, and security (Crossley & 
Mubarik, 2002). Consequently, there could be inherent differences between the two populations examined in this 
study which could skew results. Steps will be taken in future studies to determine if a revision to the medical school 
TBL, which reduces the stress level for students, would produce similar qualitative improvements while maintaining 
the educational benefits. 

5. Conclusion 

Most educational studies on the Scholarship of Teaching and Learning (SOTL) focus on improvements in student 
comprehension of material. This is a lofty goal, and one that is certainly important for student success. However, 
despite having similar focuses, educational studies from different groups often find conflicting results and 
reproducibility continues to be an issue in SOTL (Kember, 2003). The current study indicated that the qualitative 
experience of students is an important consideration that should not be neglected. Implementation of a low-stress 
TBL in the dental curriculum resulted in similar educational gains but an improved student qualitative experience. 
Dental students indicated more positive perceptions of the impact of TBL on their understanding of class content, 
exam performance, and benefits in learning. This indicates that alterations to traditional teaching methods may have 
drastic effects on student perceptions of the technique, and should be carefully evaluated in all educational studies. 
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